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Prom thermodynamic origins, the concept of 
entropy has expanded to a range of statistical 
measures of uncertainty, which may still be ther- 
modynamically significant [Tl [2]. But, laboratory 
measurements of entropy continue to rely on di- 
rect measurements of heat. New technologies 
that can map out myriads of microscopic de- 
grees of freedom suggest direct determination 
of configurational entropy by "counting" in sys- 
tems where it is thermodynamically inaccessible, 
such as granular[5"8j and colloidal[9 13] materi- 
als, proteins[14j and lithographically fabricated 
nanoscale arrays. Here, we demonstrate a condi- 
tional probability technique to calculate entropy 
densities of translation-invariant states on lattices 
using limited configuration data on small clusters, 
and apply it to arrays of interacting nanoscale 
magnetic islands ("artificial spin-ice" [15j). Mod- 
els for statistically disordered systems can be as- 
sessed by applying the method to relative en- 
tropy densities. For artificial spin-ice, this analy- 
sis shows that nearest neighbor correlations drive 
longer-range ones. 

Our artificial spin ice}15[ systems are arrays of litho- 
graphically defined single-domain ferromagnetic islands 
(25 nm thick and 220 nm x 80 nm in area) on the 
links of square and honeycomb lattices (Fig. [T]) . Shape 
anisotropy forces island moments to point along the long 
axes, forming effective Ising spins. The coercive field 
is about 770 Oe (i.e., a barrier of order 10^ K), while 
the field from one island on a neighbor only of order 10 
Oe (IC^ K). The arrays are demagnetized by rotating in 
an in-plane external magnetic field Hcxt, initially strong 
enough to produce complete polarization, subsequently 
reduced to zero in small increments [15j [16] ATfext, with 
reversal of the field at each step. For small step sizes, the 
result is a statistically reproducible macrostate, opera- 
tionally defined by the demagnetization protocoi p^ll6j . 
which is probed by magnetic force microscopy to obtain 
the static moments of individual islands. We want the en- 
tropy of a single macrostate, but distinct runs might pro- 
duce distinct macrostates (for example, a residual mag- 
netization at larger step size). In most cases, data are 




2-Ui/]-out (J-iJi/3-oui 



FIG. 1. Artificial spin-ice arrays, a. AFM image of 
400 nm square lattice with inset showing lattice spacing, and 
schematics of vertex types, b. Similarly for 520 nm honey- 
comb lattice. 



collected in a single run, averting the problem, but the 
entropy of macrostate mixture would be relatively unim- 
portant anyway, as is shown in Supplementary Informa- 
tion §3. For large structurally regular systems such as 
ours, it is more appropriate to work not with total en- 
tropy, but with entropy density [See Eq. ^] having units 
of bits/island, a value of 1 corresponding to complete dis- 
order. 

The strongest interactions, between islands meeting 
at a vertex, favor head-to-tail moment alignment. But 
not all these can be satisfied simultaneously, resulting 
in a kind of frustration. Still, for the square lattice. 
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the ground state is only two-fold degenerate [H], since 
Type-I vertices, as defined in Fig. 1, are lowest in en- 
ergy. That the ordered ground state is never found 
experimentallylini [17] suggests that the evolution is ki- 
netically constrained |181 [TO] . For instance, one spin flip 
converts a Type-II to a Type-III; flips of two perpendic- 
ular islands are required to reach Type-I. In contrast to 
the square lattice, the honeycomb lattice has a macro- 
scopically degenerate ground state when only nearest or 
next-nearest neighbor interactions are effective (longer- 
range interactions break the degeneracy [50] at a much 
lower energy scale). The interactions prefer a 2-in/l- 
out or l-in/2-out arrangement at every vertex ("quasi- 
ice rule"). This constraint alone produces a state, ideal 
quasi-ice, with an entropy density of 0.724 bits/island. 
Interaction between (mono)pole-strengths Q at neighbor- 
ing vertices [21 , 22J reduce the ground state degeneracy to 
0.15 bits/island by favoring Q = — 1 (2-in/l-out) next to 
Q = -1-1. The contrast between the square and honey- 
comb lattice ground states - two-fold degenerate versus 
macroscopically degenerate - provides an opportunity to 
investigate the interplay between the strictures of kinetic 
constraint and the freedom of massive degeneracy. 

We now develop a method to extract the entropy den- 
sities on our lattices from the measured configurations of 
the island magnetic moments. Consider a finite cluster 
A of islands, for example, the 5-island cluster comprising 
two adjacent vertices (See Fig. [2] legend) and the collec- 
tion of random variables cta which are the spins belonging 
to A. The Shannon(-Gibbs-Boltzmann) entropy[ 
of Pa(ca), the distribution of cta, is 



^(PA) = -^P('TA)l0g2P(^7A), 



(1) 



where the sum runs over all possible values of the random 
variable(s) cta- Note that S is rendered dimensionless 
by omitting Boltzmann's constant, and the base of the 
logarithm is 2, so that the units are bits. If A is taken ever 
larger while the fraction of islands on the edge tends to 
zero (van Hove limit), we obtain the bulk entropy density 
s: 



,. ^(Pa) 
s = hm I . I 

A/'oo |A| 



(2) 



If each island moment independently points either way 
with probability 1/2, then the entropy density is one bit 
per island, the largest possible. Lower entropy density 
indicates correlations in a generic sense. For example, 
the fully-polarized initial state created by a large i?oxt 
has zero entropy density. 

The obvious approximation to s suggested by Eq. Q 
is simply 5'(Pa)/|A| for the biggest practicable cluster. 
But this "simple cluster-estimate" is not very good be- 
cause the configuration space grows exponentially with 
cluster size |A|, while boundary-crossing correlations are 



completely neglected. To understand the latter point, 
suppose the entire lattice covered without gaps or over- 
lap by translates of A. The state constructed from the 
marginals of P on those translates, taking them indepen- 
dent, has entropy density exactly S{Pa)/\A\. However, 
short-range boundary-crossing correlations are the same 
as corresponding intra-cluster correlations, so are re- 
flected in small-cluster data and can be properly counted 
using conditional entropy. The method resembles one 
proposed some years ago [261 [?7] for Monte Carlo simula- 
tions of lattice spin models in equilibrium. 

One way to think of the total entropy of a given 
macrostate is as the average uncertainty about the par- 
ticular microstate at hand. Imagine a microstate of 
the honeycomb lattice revealed three islands (one ver- 
tex) at a time, row-by-row. One instant in the pro- 
cess looks like this (the grey vertex is about to be re- 
I I I 

vealed): *** I I I I *** Neglecting the (far 

♦ 
♦ 

distant) lattice edge, each newly revealed vertex bears 
the same spatial relation to those already known, so the 
revelation, on average, reduces the uncertainty by exactly 
3 times the entropy per spin. Cast this way, the entropy 
density appears as a conditional entropy (28j. The con- 
ditional entropy of cta given CTr is 

S{aK\nr)^~ J2 P(fTA, ^r) logs P(aA|CTr), (3) 

where P(CTA|CTr) = P(cta, CTr)/P(CTr) is the conditional 
probability of cta given CTr- The joint entropy of cta 
and CTr then has the pleasant decomposition ^(cta, err) ~ 
S{(Jh\<^T) + S'(CTr). (Learning CTr and cta at once is the 
same as learning CTr and then cta.) Note that if A and F 
overlap, common spins contribute zero to S" (cta | CTr). 

As a simple illustration, suppose A and F are single 
islands, with the probabilities for P(CTA,CTr) being given 
by Pa,t) = and P(t,t) = P(t,;) = PU,!) = 1/3. 
If we know that CTr =t, then the remaining uncertainty 
about Cta is zero, but if we know that CTr =i, then the 
uncertainty is total: 1 bit. Weighting by the probabilities 
of CTr to be t or I gives the entropy of cta conditioned on 
CTr: P(CTr =t) • (0) + P(CTr =i) • (1) = 2/3 bit. 

The Methods section explains how conditional entropy 
and other basic notions of information theory can be used 
to obtain good approximations to the entropy density s 
from limited data. The result of applying two such ap- 
proximations to the experimental data for honeycomb 
lattices are plotted in Fig. [2] as a function of field step 
size Aflext for each lattice constant, along with one sim- 
ple cluster-estimate for comparison. Data-set sizes are 
reported in Supplementary Information §1. The simple 
cluster-estimate S'(A)/|A| using the five-island di-vertex 
(Fig. [2] legend) provides a very poor bound compared to 
our conditioning technique. Reducing lattice constant or 
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FIG. 2. Entropy density upper bounds for honeycomb 
artificial spin ice at four lattice constants as a func- 
tion of the demagnetization step size AHa^t- AH bounds 
are derived using configuration statistics for the 5-island clus- 
ter As shown in the inset. Crosses are the direct estimate 
S'(A5)/5, while filled diamonds use inequality Q and open 
circles use inequality ([5|. The dashed lines are the result of 
our technique applied to ideal quasi-ice (every vertex Type-I 
with no other restrictions) , the upper from the simple cluster- 
estimate, and the lower two (indistinguishable) from the two 
conditioning approximations. The simple cluster-estimate ap- 
plied to a single vertex would give 0.86 bit/island. The solid 
line at 0.724 shows the actual entropy density of ideal quasi- 
ice. At the smallest lattice constants and smallest step sizes, 
subtle signs of longer-ranged monopole correlations appear. 



step size should lower the entropy since the first leads to 
stronger interactions, and the second gives interactions 
a better chance to be the decisive factor for island flips. 
The expected lattice constant trend is seen but there is 
an unexpected plateau with respect to AiJoxt- 

It makes sense to compare the experimental states 
to ideal honeycomb quasi-ice through entropy densities. 
That of honeycomb quasi-ice is 0.724 bit/island (Sup- 
plementary Information §2). But proper comparison re- 
quires using the same estimates for both systems. Dashed 
lines in the plot show the estimates for the model sys- 
tem, the upper for the simple cluster-estimate (com- 
pare crosses) and the lower two (indistinguishable) for 
the conditioning estimates. Hence, the 520 nm array at 
A7?ext ~ 1-6 Oe has less entropy than ideal quasi-ice. 
This can be explained by correlations between net mag- 
netic charge Q = ±1 of nearest-neighbor vertices. Ideal 
quasi-ice has a weak anticorrelation: {QiQj) ~ —1/9. 
In some samples, this correlation reaches -0.25, reflected 
in a small entropy decrease. Complete sublattice order- 
ing, {QiQj) —1, would reduce the entropy to s ~ 0.15 
bit/island (Supplementary Information §2). This extra 
correlation may explain the slightly better performance 
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FIG. 3. Entropy density upper bounds for square lat- 
tice artificial spin ice. The three approximations agree 
closely. Even extrapolated to zero step size, AC demagne- 
tized square spin ice never approaches the ground state. The 
diamond estimate is always lower than the square because the 
former retains more conditioning, whereas the added islands 
are the same. Dataset sizes are reported in Supplementary 
Information. 



of the bound with a complete vertex in the conditioning 
data. 

The entropy of honeycomb artificial spin ice reveals a 
state close to ideal quasi-ice, with slight antiferromag- 
netic vertex charge ordering. The contrasting failure of 
AC demagnetization of the square lattice to approach 
the completely ordered ground state is precisely quan- 
tified by entropy. We use three approximations (upper 
bounds) for the square lattice entropy density. They are 
found by a procedure parallel to that for the honeycomb 
lattice and are shown in the legend of Fig. [3) The three 
agree well, and this rough convergence test suggests that 
they are close to the true entropy densities. As for the 
honeycomb lattice, we expect smaller entropy for smaller 
AiJcxt or smaller lattice spacing. In general, this seems 
to be the case, but the ground state is never approached. 
Even extrapolations AH^xt ^ have large entropy den- 
sities. 

Closer inspection suggests jamming at AHcxt- Kinet- 
ically constrained approach to ground states defines be- 
havior of complex systems across many fields [19], such 
as protein folding[14], self-assembly, glasses and granular 
systems [3HH]- Ergodicity is thwarted by both tall energy 
barriers and configuration space constrictions, combined 
into free energy barriers. An ergodic system explores 
all of configuration space, whereas folding proteins live 
within a "folding funnel." This dynamic constriction of 
allowed configurations introduces many deep conceptual 
challenges. AC demagnetized artificial spin ice puts the 
conceptual challenge of kinetic constraint into sharp re- 
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lief: as the rotating external field weakens, islands one- 
by-one fall out of "field-following" mode, driven by inter- 
island interactions that suppress the local depolarization 
field and lock in the orientation of the fallen-away island. 
Thus each spin likely makes only a single decision on 
how to point upon escaping coercion, with no prospect 
of later surmounting barriers. The system's approach 
to the ground state is essentially one-way. Thus it is not 
surprising that only a macroscopically degenerate ground 
state target can be "hit." Notwithstanding this failure of 
ergodicity, square-lattice artificial spin ice can still be de- 
scribed by a statistical model based, like thermodynam- 
ics, on maximum entropy [m Hi]. As an extreme case 
of kinetic constraint, rotationally annealed artificial spin 
ice can afford unique insights into statistical mechanics 
of complex systems. For example, array topology can 
control the ground-state degeneracy, as seen here. 

Even without detailed knowledge of how the final 
square lattice states develop, a concisely descriptive 
model may be sought. We conjecture that the lattice 
state is fully determined by correlations between nearest- 
neighbor pairs diagonally, or straight, across a vertex, 
and thus model it by a constrained maximum entropy 
state, which is as random as possible, consistent with 
those correlations. Adapting the conditioning techniques 
(see Methods section), we can efficiently estimate the 
entropy density of the experimental states relative to 
the maximum entropy state, s(expt||ME). This global 
measure of dissimilarity does not depend on identifying 
the "right" correlations, and allows an assessment of the 
model. Results are given in the following table. 

s(expt||ME) (10-3 bit/island) 



lattice (nm) 


Aifext (Oe) 






1.6 3.2 9.6 12.8 


16 


400 


5.1 4.2 13.5 2.9 


9.2 


680 


4.5 5.6 9.1 5.4 


5.0 


880 


4.4 16.1 7.9 1.4 


2.6 



Note that [29] the probability that a typical exper- 
imental state in region A is likely to be mistaken 
for a maximum entropy state decays asymptotically as 
exp[— |A|s(expt||ME)]. Apparently, the entropy reduc- 
tion below independent islands in the square lattices is 
well accounted for by nearest-neighbor correlations, and 
those they entail. 

The reduction in the entropy of an interacting sys- 
tem below that of uncoupled degrees of freedom is due 
mostly to short-range correlations, even near a critical 
point. Thus, the efficient conditional entropy technique 
described here can be applied to a wide variety of resolv- 
able complex systems such as granular media and col- 
loidal systems which can now be spatially resolved in 
the required detail [5Hl3). Entropy density is a general 
measure of order which is not tied to pre-identified corre- 
lations. Hence it is especially valuable for states such as 



square ice or other jammed, glassy states which are far 
from identifiable landmarks. 



METHODS 

According to the discussion around Eq. ([s]), the en- 
tropy density s of the infinite honeycomb lattice is given 
by (ignore the color for now) 



3s = S 



I I I 
I I I I 



I I 
I I I I ■•• 



(4) 



Now we find small-cluster approximations to this entropy 
density, using two principles J28|. (A) If tJr is known there 
is no uncertainty about it, so 5 ( cr a, crr|(7r ) = S{a\\aY) 
for arbitrary A and F. Thus, in pictorial equations, vi- 
sual perspicuity will dictate retention or omission of con- 
ditioning variables on the left of the bar. (B) Provid- 
ing more conditioning information lessens uncertainty: 
S{a\\ar) > S'((TA|(Tr, crp')- Unlike a simple application 
of Eqn. ([2|, our conditional entropy method fully ac- 
counts for short-range correlations without boundary er- 
ror. Like the simple cluster-estimate, it provides upper 
bounds on the true entropy density. Dropping all but the 
red islands in Eqn. Q yields 



3s< S 



(5) 



Alternatively, if we add a vertex in two stages rather than 
all at once as in Eq. Q, we immediately arrive at 



3s = S 
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(6) 



The red islands again provide a visual cue. Following it, 
we get the bound 



3s< S 



J (7) 



Bounds for a translation-invariant state on the square 
lattice can be obtained in a similar way. We use the 
one-step bounds 



2s< S 



I 



(8) 
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and 

2s<S 

and the two-step bound 



(9) 



2s< S 



I 



I 
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J (10) 



A constrained maximum entropy state on the square 
lattice with given correlations between diagonal and 
accross-the- vertex nearest neighbor correlations coincides 
with a Gibbs state for an Ising model with effective pair 
interactions for the two types of nearest neighbors of 
whatever strength is required to reproduce the required 
correlations. We have previously [TB] studied specific pair 
correlations in such maximum entropy states using Monte 
Carlo simulation. Building on the conditioning tech- 
niques developed in this Letter, we compute s(expt||ME), 
the relative entropy density of an experimental state to 
the corresponding constrained maximum entropy state. 
In the case of two probability measures on the configu- 
ration space of a lattice system, the relative entropy of 
their restrictions to some finite region A is 

s{Qa\\Pa) =E.,l0g2(^) QK) 



log^QA)^- [hg^PA)^- (11) 
The limiting relative entropy density which we want is 



s{Qa\\Pa) = lim \A\-'S{Qa\\Pa)- 

A/'oo 



(12) 



The logarithm of the probability in Eq. (11) can be ex- 



panded in terms of conditionals just as was done for the 
entropy. For any collection {Xi, . . . , X^} of random vari- 
ables (the m = 1 term being read as an unconditioned 
probability) , 



N 



log2 P{Xm, ...,Xi)^Yl l0g2 P{X,n\X„,-i, . . . , Xi) 



m— 1 

parallels exactly the formula 

N 



S{Xn, . . . , Xi) — S(Xm\Xm-l, ■ ■ ■ , Xi). 



m— 1 



The main difference is that log2 P{-) is a random variable, 
whereas S{-) is a number. Any of the class of approxi- 
mations for the conditional entropy densities can now be 
applied to the conditional probabilities to obtain the rel- 
ative entropy. However, we do not get bounds in this 
way, just ordinary estimates. 

If Paie is a maximum entropy state constrained to 
have expectations of specified observables match their 



expectations in P, then the relative entropy density 
s{P\\Pme) ought to equal the difference in the absolute 
densities. We believe that the method we have used is su- 
perior to this simple subtraction because it suppresses the 
unwanted effects of fluctuations in the counting of low- 
probability configurations. Due to limited experimental 
data, configurations which would be expected to have 
only a few occurences may have none at all, which has an 
anomalously large effect in the subtraction. Acknowl- 
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SUPPLEMENTARY INFORMATION 1: DATA 
SET STATISTICS 

All data for each combination of lattice spacing and 
field step size are gathered after a single demagnetiza- 
tion run, except for 680 nm and 880 nm with ATJ^xt — 
9.6 Oe, which incorporate data from two runs. For 
square lattices, magnetic force microscopy images have 
size 10 /Ltmx 10 /xm, 17/imxl7/xm, or 22/imx22/im for 
lattice constant 400 nm, 680 nm and 880 nm, respec- 
tively, in order to have approximately the same number 
of islands in each image, although this condition is not 
important to the results. A varying number of images 
are taken at well-separated points on the array. For 
honeycomb lattices, a similar procedure was followed. 
All images are lO/imxlO/xm, except for the runs at 
1.6 Oe, which, by historical accident, are 6/zmx6/zm, 
8/imx8/im, 10/imxlO/ini, or 14/inixl4/im for the 520 
nm, 600 nm, 739 nm and 981 nm lattice, respectively. 

For honeycomb lattices, from the images, the configu- 

I 

ration of every 5-island cluster I or rotation thereof 
is recorded as a separated data point and all data a for 
given lattice spacing and A_ffcxt is combined. The num- 
bers of such data points entering our analysis are as fol- 
lows: 



Lattice 




field step 






1.6 Oe 3.2 Oe 9.6 Oe 16 Oe 


520 nm 


831 


3332 


1754 


2836 


600 nm 


1620 


3984 


3333 


2291 


739 nm 


1964 


2244 


2759 


1770 


981 nm 


2096 


2098 


3286 


2317 



For square lattices, the 7-island cluster and 
rotations thereof are used. The sizes of those data sets 
are: 



Lattice 


field step 

1.6 Oe 3.2 Oe 9.6 Oe 12.8 Oe 16 Oe 32 Oe 


400 nm 


3861 2729 5523 6363 


4158 


4699 


680 nm 


3848 2225 1843 1793 


3595 


1870 


880 nm 


3074 3196 3079 3268 


3870 


3001 



The raw data (MFM scans) for square lattice ar- 
rays used here were the basis of a previously published 
study [16]. 



SUPPLEMENTARY INFORMATION 2: 
ENTROPIES OF HONEYCOMB LATTICE IDEAL 
STATES 

In this section, we substantiate claims in the Letter 
about the entropies of two ideal states on the honeycomb 



lattice: quasi-ice and quasi-ice with full sublattice polar- 
ization. The former is the state obtained by imposing the 
quasi-ice rule (2-in/l-out or l-in/2-out) at every vertex. 
The latter is more restricted: vertices on one sublattice 
must be 2-in/l-out (Q = —1) and those on the second 
sublattice, l-in/2-out (Q = +1). This is a broken sym- 
metry state as it entails a choice of which sublattice is 
which; for our purposes, we simply pick one. 

Quasi-ice 

We will show that the quasi-ice state is equivalent to 
the ordinary nearest-neighbor Ising model having spins at 
the vertices of the honeycomb lattice, at the special cou- 
pling value tanh(J/A;BT) = 1/3. On a given graph with 
periodic boundary conditions, the partition functions of 
the two models differ only by a trivial factor: quasi-ice 
degrees of freedom reside on the edges of the graph, those 
of the Ising model, on the vertices. Quasi-ice is a combi- 
natorial problem, so the logarithm of the partition func- 
tion is precisely the entropy we need. The equivalence 
equates it with the /ree energy of the honeycomb-lattice 
Ising model at a special temperature, which is available 
from the exact solution [30H32] . Alternatively, the expan- 
sion developed below can be used directly. 

The equivalence is established through a represen- 
tation of the quasi-ice partition function in a high- 
temperature expansion |33l [34]. Here is a fragment of 
quasi-ice 




taken from a lattice A equipped with periodic boundary 
conditions. We think of A as a graph with vertex set 
F(A) and edge set i?(A). The partition function, which 
simply counts configurations allowed by the quasi-ice rule 
is 

^A-E n ^»(^)- (13) 

CTA ieV(A) 

The sum is over all assignments of arrows to the edges (as 
in the figure), and the factors Hiia) represent the quasi- 
ice-rule: Ti{a) is equal to one if the configuration a on 
the edges incident to vertex i satisfy the rule, otherwise 
it is zero. 

To proceed, we introduce extra variables. Two "spins" 
are assigned to the edge ij, aj, belonging to vertex i 
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and cr*, belonging to vertex j. We can think of them 

as arrows, or as ±l-valued objects: af is regarded to be 
+1 if the corresponding arrow points away from vertex i. 
Then we remove the redundancy by requiring = — f*, 
writing the partition function as 

^A=E n ^^(^) n '^K'-^p- (14) 

The point of this maneuver is that the Kronecker deltas 
can be rewritten as 



1 



(15) 



which form allows expansion. The same trick was used by 
Nagle[35| for the square lattice ice model. The partition 
fimction can thus be written as, 



(16) 



where (•)o denotes expectation in the system of decoupled 
vertices, which has partition function 



4"^ = E n ^«(-)- 



(17) 



{crj} iev(A) 



Since the quasi-ice constraint Ti allows six configura- 
tions of spins attached the vertex i. 



^(0) ^ glV^I ^ (g2/3yiJ| 



The prefactor to the expectation in Eq. ( 16 ) is 

g(§log6-log2)|£;| 



(18) 



(19) 



The coefficient of \E\ in the exponent is 0.50136 = 0.7233 
bit. This zero-order approximation to the quasi-ice en- 
tropy density is already fairly accurate. 

The product in the expectation is now expanded as 

n(i-aH)= E n(-'^H)- (20) 

ij£E GCEijeG 

The crucial observation at this point is that (cr,^)o — and 
{afafaDo = when j, k and / are distinct, because the 
quasi-ice rule is spin-flip invariant. Also (cr-(Tf)o = —1/3. 
This shows that when the expectation of the expansion in 



Eq. ( 20 ) is taken, the term for graph G yields zero unless 



in has an even number (0 or 2) of edges incident on each 
vertex. Further, G must consist of simple closed loops, 
no two of which have vertices in common. This follows 
from the fact that there are only three edges of A incident 
on each vertex. If two belong to G, the third cannot, and 
the first two must be part of a simple closed loop. For 
each vertex in a loop, we get a factor {crfaf)o = —1/3, 



and for each edge, a factor —1 [from Eq. ([20|]. Since a 
closed loop 7 has an equal number of edges and vertices, 
the minus signs cancel and its weight is simply (1/3) I'*''. 
Thus, 



n (1--H)) - 



Vi.jeE{A) 



E n 

disjoint{7Q} " 



|7»I 



(21) 



By comparing to the high-temperature expansion of the 
honeycomb lattice Ising model, (3^/^/2^/^)I^IZa is seen 
to be equal to the Ising model partition function at 
tanhJ = 1/3. From an exact solution for the latter 
model (references above), s — 0.724 bit/island. It is also 
practical to apply polymer expansion techniques to the 
right-hand side of Eq. ([2l]). 



Vertex-charge-ordered quasi-ice 



If the quasi-ice constraint is strengthened to require 
that all vertices on one sublattice are 2-in/l-out {Q = 
— 1) and all on the second sublattice are l-in/2-out 
{Q — -1-1), the vertex-charge-ordered quasi-ice state is 
obtained. We show how to match the configurations of 
this state one-to-one with those of the triangular lattice 
Ising antiferromagnet at zero temperature. Since an ex- 
act solution[32l [36l [37] is available for the latter, the 
problem is again solved. The equivalence in this case 
is a simple observation. Each vertex on the first sublat- 
tice has precisely one out island, and that island is the 
only one pointing in to the vertex at its other end. Thus, 
each vertex-charge-ordered quasi-ice configuration corre- 
sponds to one dimer covering of the lattice: a selection 
of edges such that each vertex is touched by exactly one. 
For example, 




Passing to the dual lattice, which is a triangular lattice, 
we get a picture like this 
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in which one edge of each triangle is selected. Now iden- 
tifying these as the frustrated bonds of an Ising model 
on the triangular lattice {diCTj — +1), it is clear that 
the dimer coverings are in one-to-one correspondence 
with ground state configurations of the triangular lat- 
tice Ising antiferromagnet. Transcribing exact results for 
that modellMllSSlinT], s = 0.155 bit/island. 



The vertex-charge-ordered quasi-ice state is also equiv- 
alent to a 5-vertex model in which one of the vertices of 
the usual 6- vertex model is forbidden (see figure below). 
Wu[38| first noted the equivalence of the honeycomb lat- 
tice dimer problem with a 5-vertex model under the name 
"modified KDP model." Blote and Hilhorst 39] noticed 
the connection with the triangular lattice Ising antiferro- 
magnet. The 5-vertex model is of interest as a model of 
the terrace-ledge-kink picture of surface growth 



\f A 



FIG. 4. Equivalence between vertex-charge-ordered quasi-ice 
and a 5-vertex model. 



SUPPLEMENTARY INFORMATION 3: 
MACROSTATE MIXTURES 



We indicate how the connection is made. First, deform 
the angles in the honeycomb to make a brickwork (lad- 
der) lattice as at the top of Figure |4] Vertices are paired 
up according to the shaded blocks. Without loss of gen- 
erality, assume that the sublattice symmetry is broken 
such that the left-hand vertices in each block are 2-in/l- 
out and the right-hand ones are l-in/2-out. It is easy 
to see that the arrows on the edges inside the blocks are 
fully determined by the others. So, the blocks may be 
contracted to vertices on a square lattice as at the bot- 
tom, and the vertices can be uniquely re-expanded to 
reconstruct the original lattice. The vertices which occur 
(with equal weight) are five of the six vertices of the 6- 
vertex square ice model [5T]: one is forbidden. 




because it has two outgoing (ingoing) arrows for the left- 
hand (right-hand) vertex of a block. 



Suppose the macrostate produced by the experimen- 
tal protocol was nonunique, for example, if the array 
was left with macroscopic magnetization pointing in a 
random direction, or if the island interactions led to a 
spontaneous symmetry breaking. Then, sampling over 
the course of multiple runs would be tantamount to sam- 
pling from a mixture of macrostates, corrupting the en- 
tropy measurement with a spurious entropy of the mix- 
ture. It is interesting to see how much our technique is 
affected by this problem. Labelling distinct macrostates 
by 9, assume for simplicity that they all have the same 
entropy density, as would hold in case of a broken sym- 
metry. Then, what we want is the entropy conditioned 
on 6. Apropos the straightforward method, observe that 
5(cr) - SiaA\0) = S{e) - S{0\aA), so that the spuri- 
ous entropy counted for a cluster is the average informa- 
tion that cluster provides about the macrostate parame- 
ter. On the other hand, for the conditioning technique, 
5(CTA|CTr) - S'(crA|crr, 0) ^ S{0\aA, or) - S{9\(7r), so that 
the spurious entropy count is only the additional infor- 
mation about 9 brought by a a, over what is already pro- 
vided by CTr- In general, this would seems to be another 
superiority of our technique compared to the straightfor- 
ward one. 
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The relation of this to our data analysis has two 
sides. First, for most combinations of lattice spacing 
and AiJext) our data come from a single run anyway. 
However, there is ample evidence that there is no overt 
cooperative symmetry breaking; the only sort of multiple 
macrostates would be a residual magnetization. We have 
symmetrized our raw data over discrete lattice symme- 
tries, as a way to reduce sampling error under the as- 
sumption that the underlying state respects those sym- 
metries. There are indications that the largest step size 
(32 Oe) may result in a slight residual macroscopic mag- 
netization, in which case the symmetrization procedure 
may be questioned. Even supposing the residual magne- 
tization to be present, however, the symmetrization only 
reduces it by a small discrete symmetry and therefore 
leaves most of its effects intact. 
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